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FOREWORD 


This  report  presents  an  alternate  method  to  the  solution  of  the  kappa  guidance  optimal 
control  problem.  Kappa  guidance  is  a  method  of  computing  midcourse  guidance  for  missiles, 
e.g.,  surface  to  air  missiles.  The  kappa  guidance  optimal  control  problem  comprises  the  state 
dynamical  equations  and  the  cost  function.  The  cost  function  is  set  to  maximize  the  proba¬ 
bility  of  kill.  The  objective  of  optimal  control  is  to  solve  the  state  dynamical  equations  while 
minimizing  the  cost  function.  The  original  published  method,  in  Reference  [2]  to  this  report, 
gives  a  suboptimal  feedback  controller.  This  controller  generates  a  solution  to  the  guidance 
equations  so  trajectories  may  be  computed.  It  is  suboptimal  since  approximations  are  made  in 
its  derivation.  The  alternate  method  presented  is  referred  to  as  linearized  kappa  guidance  since 
a  linearizing  coordinate  transformation  and  nonlinear  feedback  are  used  on  the  nonlinear  state 
dynamical  equations.  The  linearized  method  is  also  suboptimal,  as  approximations  are  made  in 
its  solution;  however,  the  approximations  are  different  from  those  used  in  the  original  method. 
The  main  feature  of  the  linearized  method  is  that  closed  form  solutions  for  the  states  are  derived. 
Such  closed  form  solutions  for  the  states  were  not  obtained  in  the  original  derivation.  The  costs 
of  trajectories  computed  by  each  method  for  identical  initial  conditions  are  comparable. 

This  report  has  been  reviewed  by  A.  Garza,  Head,  Systems  Engineering  Branch,  and  R.E. 
Lutman,  Head,  Combat  Systems  Engineering  Division. 


Approved  by: 


L.M.  WILLIAMS,  III,  Head 
COMBAT  SYSTEMS  DEPARTMENT 
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CHAPTER  1 
INTRODUCTION 


In  this  report,  an  alternate  solution  method  to  the  k  guidance  optimal  control  problem  is 
presented.  Kappa  guidance  is  a  technique  for  computing  the  midcourse  guidance  of  a  missile;  e.g., 
a  surface  to  air  missile.  Kappa  guidance  optimizes  the  midcourse  trajectory  of  a  missile  so  that  the 
terminal  velocity  is  maximized.  This  increases  the  probability  of  kill.  The  current  solution  method 
for  the  K  guidance  optimal  control  problem  (which  we  will  also  refer  to  as  the  original  method)  is  to 
write  the  Hamiltonian  and  obtain  a  solution  from  the  necessary  conditions.  Closed  form  feedback 
controllers  are  obtained  for  both  the  free  final  angle  of  approach  case  and  the  fixed  final  angle 
of  approach  case  with  the  original  method.  The  original  solution  method  is  suboptimal  because 
approximations  are  made  in  its  derivation.  In  this  alternate  method  the  nonlinear  dynamics, 
which  also  vary  with  respect  to  the  independent  parameter  range,  are  linearized  via  a  nonlinear 
coordinate  transformation  and  nonlinear  feedback.  The  cost  function,  which  is  nonlinear,  is  still 
nonlinear  in  the  transformed  coordinates.  A  quadratic  approximation  to  the  cost  function  is  made 
in  the  transformed  coordinates.  Then  the  (transformed)  guidance  problem  is  solved  using  Linear 
Quadratic  Regulator  (LQR)  control  on  the  linearized  dynamics  and  approximate  quadratic  cost. 
Closed  form  state  equations  and  adjoint  variable  equations  are  obtained.  That  is,  the  velocity 
vector  angle  and  heading  error  angle  for  the  midcourse  trajectory  are  known  in  closed  form  with 
this  alternate  method.  Because  of  the  cost  approximation,  the  alternate  solution  method  is  also 
suboptimal.  The  main  feature  of  the  alternate  method  presented  here  is  that  closed  form  solutions 
for  the  states  are  derived.  Such  closed  form  solutions  were  not  obtained  with  the  original  method. 
The  costs  of  trajectories  computed  by  each  method  for  identical  initial  conditions  are  comparable. 

In  Chapter  2,  the  k  guidance  optimal  control  problem  will  be  reviewed.  A  detailed  discussion 
of  K  guidance  and  the  original  method  is  given  in  Lin.^^^  In  Chapter  3  the  dynamics  of  the 
problem  are  linearized  using  a  nonlinear  coordinate  transformation  and  nonlinear  feedback.  The 
LQR  optimal  control  problem  is  set  up  in  Chapter  4.  The  necessary  conditions  are  given  and 
solutions  considered  for  free  and  fixed  final  angles  of  approach  in  Chapter  5.  Examples  comparing 
the  original  and  alternate  solutions  are  given  in  Chapter  6.  Much  of  this  paper  was  presented  in 
Serakos-Lin.t^ 
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CHAPTER  2 

DYNAMICAL  EQUATIONS 


In  this  chapter,  the  dynamical  (state)  equations  and  optimal  control  problem  will  be  reviewed. 
The  K  guidance  dynamical  equations  are 


d 

7 

K  sec  (^) 

dp 

6 

K  sec  (^)  -1-  tan  (6)  / (Rq  —  P) 

where  the  state  variables  7  and  6  are  the  velocity  vector  angle  and  the  heading  error  angle 
respectively.  The  range  to  the  projected  intercept  point  (PIP)  is  represented  by  R,  and  «  is  the 
curvature.  The  initial  range  to  the  target  is  Rq,  and  we  define  P  =  Rq  -  R.  The  independent 
parameter  in  this  problem  is  taken  to  be  P.  It  is  interesting  to  note  that  the  derivative  of  P  is 

dependent  on  the  state  variables  since  P  is  positive  or  negative  depending  on  whether  -7r/2  <6  < 
7r/2  or  ir/2  <  ^  <  — 7r/2.  (In  many  engineering  problems,  the  independent  variable  is  time,  which 
generally  does  not  depend  on  the  state  variables.)  Under  every  normal  circumstance,  however, 
— 7r/2  <  6  <  Trf 2.  The  curvature  k  is  also  the  control.  The  cost  is 


J(7,  S,  P,  k)  =  [(kV2)  +  sec  {6)  dP  , 


(2.2) 


where  w  is  a  constant  which  depends  on  aerodynamic  parameters;  see  Equation  (8-150)  of  Lin.1^1 
This  original  formulation  was  developed  by  F.  Reifler.I^  Figure  2-1  shows  the  relationships  between 
the  states.  The  state  equations,  Equation  (2.1),  may  be  derived  from  the  geometry  and  the 
definition  of  k.  The  argument  of  Equation  (2.2)  contains  which  penalizes  excessive  curvature, 
and  sec  (^),  which  penalizes  large  heading  error  angle.  These  work  to  maximize  intercept  velocity, 
which  increases  the  probability  of  kill.  Hence,  minimizing  the  cost  J (7, 6,  P,  k)  in  Equation  (2.2), 
maximizes  the  intercept  velocity.  The  discrepancy  of  these  state  and  cost  equations  with  those 
given  in  Lin,fl5  Gray-Hecht,l^l  Ohlmeyert^l  and  Serakos-Lin®  is  discussed  in  Appendix  A  (e.g., 
the  minus  signs  on  the  right-hand  side  of  Equation  (2.1)). 

We  rewrite  the  dynamical  equations  to  be  in  a  form  that  is  more  familiar  to  control  engineers. 
Let  xi  =  7  and  X2  =  S.  Then,  Equation  (2.1)  becomes 


d  x\ 
dP  X2 


0 

ta,n{x2)f  R 


sec(x2) 


1 

1 


K  . 


(2.3) 


The  variables  xi  and  X2  are  referred  to  as  the  state  variables.  Equation  (2.3)  represents  the  plant. 


Let 


/(xi,X2,P) 


0 

tan(x2)/P  ’ 


p(xi,X2,P)  =  sec(x2) 


1 

1 


(2.4) 
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DOWNRANGE 


FIGURE  2-1.  MID-COURSE  GUIDANCE 
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Then,  Equation  (2.3)  becomes 

^  =  f{Xi,X2,R)+9iXuX2,R)-K.  (2.5) 

Equations  (2.5)  and  (2.2)  represent  the  k  midcourse  guidance  optimal  control  problem.  The 
original  method  proceeded  to  solve  this  problem  by  obtaining  the  Hamiltonian  and  solving  for  the 
necessary  conditions.  A  detailed  discussion  of  the  original  method  is  presented  in  Lin,l  ^  Section 
8.6.3.  The  state  equations  are  given  in  Lin^^l  by  Equations  (8-140a,b),  and  the  cost  is  given  by 
Equation  (8-150).  (As  previously  stated,  the  discrepancy  is  discussed  in  Appendix  A.)  The  closed 
form  solution  for  the  feedback  control  in  Linl^l  is  given  by  Equation  (8-167)  in  the  free  final  angle  of 
approach  case,  and  by  Equation  (8-165)  when  the  final  angle  of  approach  is  specified.  The  original 
solution  method  is  suboptimal  since  approximations  are  made  in  obtaining  these  controllers;  see 
section  8.6.3  of  Lin.1^1 
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CHAPTER  3 

LINEARIZING  COORDINATE  TRANSFORMATION  AND  FEEDBACK 


In  this  chapter,  we  will  find  a  nonlinear  coordinate  transformation  and  feedback  that  will 
linearize  Equation  (2.5),  the  state  equation.  Consider  the  coordinate  transformation 


Zl 

Z2 


F{xi,X2,R)  = 


Xi  —  X2 

—  t&n{x2)IR 


(3.1) 


Note  that  the  transformation  exists  for  all  R  ^  0.  Although  the  independent  variable  is  P,  in 
many  cases  it  will  be  more  convenient  to  work  with  R  {=  Rq  —  P).  The  inverse  transformation  is 

zi  -  ta.n~^ {R Z2)  /q  9\ 

-tan-Hi?^2)  '  ^ 


Xi 

X2 


F  ^{z\,Z2,R)  = 


Define  a  nonlinear  feedback  by 


K  =  a{x-i,X2,R)  +  ^{xuX2,R)  •  u  , 


(3.3) 


where 


a{xi,X2,R) 


sin(a;2)(cos^(a:2)  +  1) 

R 


(3.4) 


and 

^{xi,X2,R)  =  -R  cos ^(0:2)  ,  (3.5) 

and  where  u  is  the  input  to  the  linearized  closed  loop  system.  (The  coordinate  transformation  and 
nonlinear  feedback  represented  by  Equations  (3.1)  and  (3.3)  where  derived  using  the  techniques 
from  the  differential  geometric  approach  to  nonlinear  control,  see  Isidori^^^).  Using  the  coordinate 
transformation  and  the  nonlinear  feedback,  we  compute  the  representation  of  the  closed  loop 
system  in  the  ~z  coordinates.  The  chain  rule  gives 


dP  die  dP  ^  dRdP 


Denote 


1  -1 
0  —  sec‘^{x2)l  R 


The  closed  loop  system  (Equation  (2.5) 


with  the  nonlinear  feedback  Equation(3.3))  is 


(3.6) 


dt 

dP 


OF, 


F*{f  +  goc){l^)  +  F.{g^){'x)  ■u+-^{x)  . 


(3.7) 
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Computing,  we  have  that 


■  1  -1 

0 

0  —sec^{x2)IR 

tan(3:2)/P 

+ 


1  -1 
0  —  sec^(x2)/i2 


sec(a:2) 


sin(a;2)(cos  ^(3:2)  +  1)' 

R  , 


—  ia,n{x2)l  R 

1 

0 

—  tdi.n{x2)/R 

—  sec^{x2)  tan{x2)/R^ 

"r 

860^(3:2)  sin(x2)(cos  ^(3:2)  -f  1)/P^ 

i&n{x2)/R^ 

Hence, 


Also, 


And 


F^{f  -{■  ga){'t)  = 


Z2 

-Z2IR 


1  -1 

0  —  sec^(x2)/-R 


•  800(3^2) 


(-^  cos  ^(3:2)) 


dF._,.  dF.^.dR 
dR^  ^dP 


0 


(Note  that  dRfdP  =  —1.)  So, 


dF 

dP 


(^)  = 


0 

Z2IR 


Hence,  the  closed  loop  system  in  coordinates  is 


d 

dP 


Zl 


0  1 
0  0 


Z\ 

22 


+ 


u  . 


(3.8) 


A  block  diagram  representing  the  situation  given  by  Equations  (2.3),  (2.2),  (3.1)  and  (3.3)  is  given 
in  Figure  3-1.  It  is  interesting  to  note  that  the  right-hand  side  of  Equation  (3.7)  depends  on  P 
while  the  right  side  of  Equation  (3.8)  does  not.  Apparently,  the  coordinate  transformation  F  and 
nonlinear  feedback  o:  and  /?  vary  with  respect  to  P,  in  such  a  way  that  the  dependence  on  P  in 
Equation  (3.8)  cancels  out. 
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CHAPTER  4 

LQR  OPTIMAL  CONTROL  PROBLEM  FORMULATION 


In  this  chapter  we  will  set  up  the  LQR  optimal  control  problem.  The  cost  function,  Equation 
(2.2),  is  not  in  the  desired  quadratic  form  after  the  nonlinear  feedback  and  coordinate  transfor¬ 
mation.  Hence,  a  quadratic  approximation  to  the  cost  will  be  made.  Along  with  the  linearized 
dynamics.  Equation  (3.8),  this  will  complete  the  setup  of  the  LQR  optimal  control  problem. 

The  Taylor  series  expansions  for  a  and  ^  are 


a 


2 


R 


SR 


Hence,  for  small  X2  and  u 


y 


•  •  and  ^  =  ~ 

-  +  cf!u+  — 


R  +  "I" 


2-xl 

R? 


■f  2  •  x^u  + 


R?v? 


For  small  x^,  the  secant  may  be  approximated  by 

1  1 


sec(x2)  = 


(1  -f  Ixl) 


1  4-  \xl 


(4.1) 


(4.2) 


cos(a:2)  (1  -  |x^)  (1  +  \xl) 

Since  this  is  a  quadratic  approximation,  X2  and  u  do  not  have  to  be  as  small  as  they  would  have 
to  be  if  a  linear  approximation  were  being  made.  This  point  will  be  further  considered  in  the 
examples.  From  Equations  (4.1)  and  (4.2)  we  have 


(y  +a;^)sec(a:2) 


( 


2  •  Xo 


-f-  2  •  X2U  T 


R?u'^ 


1 


2_ 

^R?  2 


R? 

2 

)X2  +  2  •  X2U  + 


2  + 


w*  ^  0  „  2 


^  I  ^ 

u  -t-  a; 


(4.3) 


The  term  in  the  right  hand  side  of  Equation  (4.3)  may  be  deleted  without  changing  the 

optimal  control  problem;  hence,  the  cost  may  be  approximated  by 


J 


/•A)  f  2 

L 


)X2  +  2  •  X2U  + 


R? 


-u 


dp . 


(4.4) 


(Later,  when  a  numerical  value  for  the  cost  of  a  particular  trajectory  is  computed,  the 
term  will  be  put  back  in.)  The  coordinate  transformation  and  its  inverse.  Equations  (3.1)  and 
(3.2),  may  similarly  be  approximated, 

1  r  ^  r  n  1 

(4.5) 


Xi  —  X2 

Xi 

1 

to 

R3 

—X2IR 

1 

^2 

-Z2R 
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In  ~z  coordinates,  the  cost  may  be  approximated  by  substituting  Equation  (4.5)  into  Equation 
(4.4)  to  get 

J^j  i^{2  +  -  2  ■  Rz2U  +  dP  .  (4.6) 

The  LQR  optimal  control  problem  is  given  by  Equations  (3.8)  and  (4.6).  The  solution  to  this 
LQR  optimal  control  problem  would  be  an  approximate  solution  to  the  original  optimal  control 
problem  given  by  Equations  (2.1)  and  (2.2). 
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CHAPTER  5 

NECESSARY  AND  SUFFICIENT  CONDITIONS 


In  this  chapter  the  necessary  conditions  and  their  solution,  for  both  the  free  and  fixed  final 
approach  angle  cases,  will  be  considered.  For  convenience  we  repeat  the  state,  or  plant,  equations 
given  by  Equation  (3.8), 


=  +  B  -u  , 


(5.1) 


where 


A  = 


0  1 
0  0 


and  B  = 


0 

1  ’ 


and  cost  function  given  by  Equation  (4.6), 


(5.2) 


-  2  •  Rz2U  +  —vr 


1 


dP 


(5.3) 


for  the  LQR  optimal  control  problem  being  considered.  The  solution  to  this  form  of  the  linearized 
quadratic  problem  is  well  known.  See  Athans-Falb.l'^3  However,  we  will  go  through  the  solution  as 
a  review.  This  will  show  the  formulation  of  the  optimal  control  problem,  the  necessary  conditions 
and  the  Riccati  equation. 


FORMULATION  OF  HAMILTONIAN  AND  OPTIMAL  CONTROL 

The  Hamiltonian -is  (see  Athans-Falb^^^) 

n{'t,~p,u,R)=C{-7,u,R)-\-(-pJ{~z,u))  , 

where 


£(1^,  u,  R)  =  {2  +  -  2  •  Rz2U  +  ^R^u^ 


and 


0  1 
0  0 


Z\ 

Z2 


+ 


u  = 


Z2 

u 


(5.4) 

(5.5) 

(5.6) 


The  vector  ~p  =  (pi,P2)'  contains  the  adjoint  variables.  Substituting  Equations  (5.5)  and  (5.6) 
into  Equation  (5.4)  gives  for  the  Hamiltonian, 


"K  =  (2  -f  -  2  •  Rz2U  +  -R^U^  +  PlZ2  +  P2U  . 


(5.7) 
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Now,  from  the  minimum  principle,  we  obtain  two  pairs  of  differential  equations  which  the  state 
and  adjoint  variables  must  satisfy.  The  first  pair  are  the  state  equations,  which  we  obtain  from 


dP 


m 

d-^ 


(5.8) 


The  second  pair  are  the  adjoint  equations, 

dy  dH 


dP 


d- 


0 

Pi  +  (4  +  B?uP)z2  —  2  •  Ru 


(5.9) 


The  optimal  control  must  minimize  the  Hamiltonian;  hence,  d7i(u)/du  =  0.  (This  is  a  necessary 
condition.)  We  differentiate  Equation  (5.7)  to  find  the  extremum  of  H  with  respect  to  u, 


— —  —  —2  •  Rz2  +  P2  H"  R'^u  —  0  . 
ou 


(5.10) 


Solving  for  u. 


u  — 


2^2  P2 


,  (5.11) 

R  R?'  ^  ’ 

where  the  asterisk  superscript  indicates  an  optimal  quantity.  To  see  that  this  control  minimizes 

the  Hamiltonian,  check  the  second  derivative  of  H: 


du^ 


=  i?"'  >  0  ; 


hence.  Equation  (5.11)  does  minimize  the  Hamiltonian.  Substituting  Equation  (5.11)  into  the 
state  and  adjoint  equations.  Equations  (5.8)  and  (5.9),  gives 


'  ■ 

Z2 

d 

^2 

2Z2IR  —  P2IP? 

dp 

Pi 

0 

.  P2  . 

4z2  -  2^2/7?  -  Pi  -  (4  +  R?u'^)z2  . 

'01  0  O' 

■  zi  ' 

0  2/R  0  -l/i?2 

Z2 

0  0  0  0 

Pi 

0  -R2a;2  _l  -2/R  _ 

.  P2  . 

(5.12) 


Equation  (5.12)  is  referred  to  as  the  Hamiltonian  system  associated  with  the  optimal  control 
problem.  It  is  of  the  form 


d 

—  > 

Z 

W 

-s  ■ 

dP 

.  'P  . 

.-Q 

-w 

.  “p  . 

(5.13) 


where 


W 


0  1 

0  2/R 


,  Q  = 


0  0 
0  R^u^ 


and  S  = 


0  0 
0  l/R^ 


(5.14) 
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The  solution  to  the  linear  homogeneous  Equation  (5.13)  is 

Pi  ^*21  “22  IP. 

where  the  0.ij  are  (unknown)  2x2  matrices. 

Two  boundary  conditions  for  Equation  (5.15)  come  from  the  known  initial  conditions  of  the 
state  variables.  The  other  two  boundary  conditions  for  Equation  (5.15)  come  from  the  transversal- 
ity  conditions.  These  pertain  to  the  various  requirements  imposed  on  the  final  angle  of  approach. 
We  consider  two  cases  in  the  following  sections.  First,  we  consider  the  case  where  the  final  angle 
of  approach  is  free.  In  this  case  the  final  angle  of  approach  which  minimizes  the  cost  is  automati¬ 
cally  selected.  Secondly,  we  consider  a  fixed  final  angle  of  approach.  In  this  case  the  final  angle  of 
approach  is  selected  by  the  user  based  on  operational  considerations.  The  trajectory  is  optimized 
subject  to  this  constraint. 


FREE  FINAL  ANGLE  OF  APPROACH  -  NECESSARY  CONDITIONS 

First,  we  assess  the  boundary  conditions  for  the  Hamiltonian  system,  Equation  (5.12).  The 
initial  conditions  on  the  state  variables  are  known,  which  give  the  two  conditions 

V(P  =  0)  =  (zio,22o)  .  (5-16) 

A  free  final  angle  of  approach  means  that  the  terminal  constraints  on  the  state  variables  are  free. 
According  to  the  transversality  conditions  for  a  free  end  point, 

y(P  =  i?o)  =  0  .  (5.17) 

(See  Table  5-1  of  Athans-Falbt’^').  Integrating  the  third  row  of  Equation  (5.12)  yields 

p,  =  0  .  (5.18) 

Substituting  this  into  the  second  and  fourth  rows  of  Equation  (5.12)  gives 

d^2  _  2^2  _  P^ 
dP~  R  B? 


(5.20) 


(5.21) 
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Applying  Equation  (5.19)  and  rearranging  Equation  (5.21)  yields  the  following  equation: 

(Pp2 


dP^ 


2  dp2  .2  2\ 

r7p ~ 


0 


(5.22) 


The  general  solution  to  Equation  (5.22)  is 

P2{R)  =  CiRsmh.{ujR)  +  C2Rcosh{ujR)  . 
We  can  then  solve  for  Z2  using  Equation  (5.20); 


(5.23) 


=  —  ^  [sinh(a;  j?)  —  wi?  cosh(a>i?)]  —  ^  [cosh(u; i?)  —  sinh(a;i2)]  .  (5.24) 

To  get  the  final  solutions  for  p2  and  Z2  from  Equations  (5.23)  and  (5.24),  we  must  evaluate  Ci 
and  C2  using  the  boundary  constraints.  The  boundary  condition  given  by  Equation  (5.17)  does 
not  help  out.  However,  if  the  missile  is  to  hit  the  target,  the  heading  error  angle  at  i?  =  0  must  be 
zero  (^(0)  =  0).  From  physical  considerations,  S{R)  =  x^iR)  is  continuous,  so  the  heading  error 
angle  should  approach  zero  as  R  approaches  zero;  i.e.. 


lim  X2(R)  =  0 

R-*o  ^  ' 


(5.25) 


(Only  continuous  solutions  for  the  state  and  adjoint  variables  are  allowed.)  When  Ci  =  0  we  have 
from  Equation  (5.24) 

Co 

Z2{R)  =  —  -p"-  „■  [cosh(a;i?)  —  u;i?sinh(wit)] 

=  ((1  +  +  0(^))  - 

Now,  Equation  (3.2)  gives 


X2{R)  =  -  tan  {RZ2)  -  -{Rz2  -  -;;{Rz2)  +  0[{Rz2f)) 


C2  (—8  +  4(a;f?)^  +  (wi?)^)  C2  (—8  +  4(a;i2)^  +  (u;i?)^)^ 

*  -»  rw  T~iO  £!  ' 


8-R 


3  a;® 


.a;2  2a;^ 


1536  •  R? 


(H.O.T.  stands  for  higher  order  terms.)  This  shows  X2{R)  goes  to  infinity  as  i?  — >  0  unless  C2  —  0. 
Hence,  to  satisfy  Equation  (5.25),  it  is  necessary  that  C2  =  0.  When  (72  =  0  we  have  from  Equation 
(5.24) 

n 

Z2{R)  =  —  —  ■ ■[sinh(a;i7)  —  u}Rcosh{u>R)] 
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0  I 

=  ^  •  wR  +  H.O.T. 
o 

X2{R)  —  —  tan“^(i22;2)  =  — ^  •  a;  •  +  H.O.T. 

«5 

In  this  case  Equation  (5.25)  is  satisfied  for  all  0  <  (7i  <  oo.  Note  that  the  ternas  in  the  series 
expansion  of  associated  with  C\  are  even  functions  of  R  and  the  terms  associated  with  C2  3‘re 
odd  functions  of  R.  This  fact  implies  that  we  may  do  an  analysis  by  taking  Ci  =  0  and  €2^0 
and  then  Ci  ^  0  and  C2  =  0-  (This  was  taken  into  account  in  the  analysis  presented  in  this 
paragraph.) 

With  C2  =  0,  we  get 

Z2(R)  =  -  --[sinh(a;i?)  -  ujRcosh{ujR)]  (5.27) 


(5.28) 


(5.29) 


and 

P2{R)  =  C'ii7sinh(a;i7)  . 

From  the  first  row  of  Equation  (5.12)  and  Equation  (5.27) 

/  ^  sinh(a;i?)  , 

zi(i?)  =  -C'i  . 

The  integration  constants  Ci  and  K2  may  be  computed  from  the  initial  values  of  7  and  6.  From 
Equations  (3.1),  (5.16)  and  (5.27)  we  have 

_tan(^R^  _  -  „  [sinh(u; j?o)  -  u;/?o  cosh(wi?o)]  • 

Ro 


Solving  this  equation  in  Ci  gives 


Rqu}'^  ta,n{6{Ro)) 


(j  — _ 

sinh(aji?o)  —  ‘^Ro  cosh(a;Ro) 
From  Equations  (3.1),  (5.16)  and  (5.29)  we  have 

sinh(cui?o) 


(5.30) 


7o  ~  ^0  —  ~Ci 


Rqoj'^ 


+  K2  ■ 


Hence, 


Ko 


Cl  sinh(a;i?o) 


R^u;'^ 


+  70  —  ^0 


(5.31) 


Next,  closed  form  solutions  for  the  (untransformed)  state  variables  are  given.  From  Equations 
(3.2),  (5.27)  and  (5.29)  we  get 


7(fi)  =  -C.  +  K,  +  cosh(a)ii)l)  ,  (5.32) 

Rw^  Ru)^ 
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and 

S{R)  =  tan“^(-^^[sinh(a;i?)  —  a;i?cosh(a;i?)])  .  (5.33) 

Such  a  closed  form  solution  for  the  state  variables  given  by  Equations  (5.32),  (5.33),  (5.30) 
and  (5.31)  was  not  obtained  in  the  original  solution  method  of  this  problem.  It  is  reiterated 
that  the  closed  form  solution  obtained  here  is  an  approximated  solution  to  the  optimal  control 
problem  given  by  Equations  (2.1)  and  (2.2)  because  of  the  quadratic  approximation  made  in  the 
cost  function  in  Equation  (4.4).  (No  other  approximation  is  made.) 


FREE  FINAL  ANGLE  OF  APPROACH  -  SUFFICIENT  CONDITIONS 


In  this  section  sufficient  conditions  for  the  optimal  control  problem  are  considered.  The 
sufficient  conditions  involve  solving  the  Hamilton-Jacobi  partial  differential  equation.  A  closed 
form  solution  to  the  Hamilton-Jacobi  equation  is  found  for  the  free  final  angle  of  approach  case. 
This  solution  also  gives  a  closed  form  solution  to  the  cost.  We  will  see  that  the  necessary  conditions 
presented  previously  are  sufficient  for  optimality. 

There  is  a  relationship  between  the  state  and  adjoint  variables.  We  demonstrate  this  next, 
which  will  also  develop  the  Riccati  equation.  Setting  Px  —  Rq  and  P2  =  P  m  Equation  (5.15)  and 
using  Equations  (5.17)  and  (5.18)  we  get 


0  =  1)21(120,  P)^(P)  +  ^22{Ro,  P)'P{P) 


so  that 

'p{P)  =  -H22(i2o,P)-'H2i(J2o,P)'i"(P)  =  K{P)~^{P) 

Substituting  Equation  (5.34)  into  Equation  (5.13),  we  get 


d 

~z 

{W-SK)-^ 

dp 

L  p  J 

.  {-Q  -  W'K)-^  . 

From  this  and  differentiating  Equation  (5.34), 


dK. 


{-Q  -  W'K)-^  =  {KW  -  KSK  -t-  . 

dP 


Equation  (5.35)  holds  for  all  ;  hence, 

dK 


—  +  AW  +  W'K  -  KSK  +  g  =  0  . 


(5.34) 


(5.35) 


(5.36) 


Equation  (5.36)  is  the  Riccati  differential  equation  for  the  LQR  optimal  control  problem.  It  may 

k  k 

'  is  symmetric;  that  is  kx2  =  ^21,  and  is  positive  definite,  see 


be  shown  that  K 


C2I  «22 


Athans-Falb.t^]  From  Equations  (5.18),  (5.27),  (5.28)  and  (5.29),  we  see  that 


0 

■  kxx{P) 

k,2{P)  ■ 

■  ^l(^)  ■ 

■  kx^{P)zx{P)  +  kx2{P)z2{P)  ■ 

.  V2(P)  . 

.  ^12(P) 

h2{P) . 

.  J 

.  h2{P)zx{P)  +  k22{P)z2{P) 

(5.37) 
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where  the  are  the  unknowns.  Equation  (5.37)  is  overdetermined;  hence,  we  select  knto  be  a 
free  parameter.  Solving  the  first  row  of  Equation  (5.37)  for  ki2  gives 

ibi2  =  .  (5.38) 

^2 

Substituting  Equation  (5.38)  into  the  second  row  of  Equation  (5.37)  gives 


,  1/  ,knZi. 

^22  —  - (P2  H - ) 

Z2  Z2 


(5.39) 


Hence, 


kxi{P) 

k,,{P)z,{P)  1 

^2(P)  Z,{P) 


hr{P)z,{P) 

.  ^2(P) 

,  hu{P)z\(P)' 

n{P)^ 


(5.40) 


Equation  (5.36)  has  a  terminal  (not  initial)  condition,  which  is  K{Ro)  =  0  (see  Table  5-1  of 
Athans-Falbl^l).  A  solution  to  Equation  (5.36)  which  satisfies  this  terminal  condition  is  unique 
(see  Athans-Falb,l^l  page  762).  It  may  be  seen  that 


K{R)  = 


■  0 
0 


0 


sinh(u;R) 

h{u)R)  —  u>R  cosh(a’J?) 


(5.41) 


fits.  The  solution  presented  by  Equation  (5.41)  was  obtained  by  setting  =  0  in  Equation 
(5.40). 

Sufficient  conditions  for  the  optimality  are  considered  next.  This  involves  showing  that  the 
feedback  control  given  by  Equation  (5.11)  satisfies  these  conditions,  and  it  will  be  seen  that  it  is 
globally  optimal.  We  refer  to  Theorem  5-13  of  Athans-Falb.1^1  First,  we  see  from  Equation  (5.7) 
that  the  Hamiltonian  is  normal  relative  to  X  =  9?^  x  (0,  Rq).  From  the  work  done  previously  in 
this  section,  it  is  seen  that  this  controller  is  the  Tf-minimal  control  relative  to  X. 

We  will  find  it  convenient  to  rewrite  the  Hamiltonian.  Consider  the  Hamiltonian  as  given  by 
Equation  (5.7).  It  may  be  rewritten  as 


u 


L\i  Li2 
Li2  P22 


z 

u 


+  +  Bu^ 


(5.42) 


where 


L\\  — 


0  0 
0  4  +  R?u}^ 


)  Ti2  — 


0 

-2R 


and  L22  =  R^  ■ 


Comparing  Equation  (5.14)  with  Equations  (5.2)  and  (5.43),  we  find  that 


W  =  A 


L 


c  PR'  r\  ^  T  P12L12 
5  =  “F — )  V  —  - T 


22 


-'22 


j22 


(5.43) 
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Substituting  these  into  the  Riccati  equation,  Equation  (5.36),  gives 

^  +  KA-  +  A'K  -  -  K^K  +  L^^  -  =  0  . 

dP  L22  7/22  7/22  7/22 


(5.44) 


The  last  part  of  the  sufficient  conditions  in  Theorem  5-13  of  Athans-Falbt^^  is  the  Hamilton- 
Jacobi  partial  differential  equation.  The  Hamilton-Jacobi  partial  differential  equation  is 


dP' 


min  u,P)  =  0  . 

“  dz 


(5.45) 


Let  J  =  \  ,  K~z'^.  Then 


dP  2 


dK^ 

z  , - z 

'dp 


dj 


and - —  Kz.  From  Equations  (5.11)  and 

d~z' 


U  B^K 

(5.43),  we  have  that  w*  =  —  |  -|-  — — 

7/22  7/22 


Substituting  into  the  Hamilton-Jacobi  equation. 


§  ^  ^  {u,L22u)  +  (^K~^,A~z 

((i'n  +  B’K)r,(L[2  +  B'l<)-t)  +  \{-t,A'K^)  +  \  {-t,KA-t) 

-^{-t  ,KB(L\^  +  B'K)t) 

7/22  ' 

=  j  (f,  ^  v)  +  i  ( V,  i„  V)  +  i  (V,  A'K^)  +  i  (V,  KAt) 

-  (^’  L22B'K-t)  -  (r,  i.2i'.2F}  .  (5.46) 

^  •  L22  'I'  L22 

Since  Equation  (5.46)  holds  for  all  values  of  "i^,  we  get  that 

~  -f  Xii  PA!K  +  KA-^- KBL[^  -  ■  KBB'K 

dr  L22  -^22 

.  L^^B'K  -  ■  L^2L[2  =  0  , 

7/22  7/22 

and  the  Hamilton-Jacobi  partial  differential  equation  is  satisfied  since  K  satisfies  the  Riccati 
equation.  As  a  consequence  of  this,  we  get  a  closed  form  solution  for  the  optimal  cost  , 

J{-f,6,P,K)  =  \{F(-t,P),K(P)F(-t,P))Aj^w-‘dP  ,  (5.47) 

where  F  is  the  transformation  given  by  Equation  (3.1).  Equation  (5.47)  will  be  verified  in  Chapter 
6,  the  Numerical  Examples  chapter.  The  last  term  in  Equation  (5.47)  is  to  account  for  the 
term  that  was  deleted  in  obtaining  the  quadratic  cost  approximation  in  Chapter  4. 
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TERMINAL  CONSTRAINT  ON  INTERCEPT  ANGLE  -  NECESSARY  CONDI¬ 
TIONS 


In  this  section,  the  LQR  optimal  control  problem  will  be  formulated  with  a  terminal  constraint 
on  the  intercept  angle.  The  state  variable  Xi  represents  the  velocity  vector  angle,  which  is  the 
intercept  angle.  The  terminal  constraint  then  is  xi{P  =  Rq)  =  7/.  In  the  transformed  coordinates, 
see  Equation  (3.1),  using  the  continuity  of  the  state  variables,  the  terminal  constraint  is 


lim 

0 


tan 


7/  • 


The  two  initial  boundary  conditions  for  Equation  (5.12) 


are 


“i*(P  =  0)  =  (210,220)  . 


(5.48) 


(5.49) 


An  integration  of  Equation  (5.12c)  gives 

Pi  =  constant  =  K\  ,  (5.50) 

where  Ki  is  to  be  determined.  (Integration  constants  in  this  section  are  not  to  be  confused  with 
integration  constants  of  the  previous  section.)  The  remaining  state  and  adjoint  equations  are 

dzi 


dZ2  _  g22 

dP  R 


El 

R?  ’ 


and 


(5.52) 


(5.53) 


The  same  differential  equation  as  Equation  (5.21)  can  be  derived  for  p2  with  the  same  general 
solution: 

P2{R)  =  CiRsmh{LoR)  +  (72/? cosh(a;J?)  .  (5.54) 

Applying  Equations  (5.53)  and  (5.54), 


z,(R)  =  -(2|  +  ^  +  K,)HRV) 


Cl 


[sinh(a;jR)  —  uR  cosh(a;i?)]  — 


(72 

R?u;^ 


cosh(u;i?)  —  uR  sinh(a;i?)]  + 


Ki 

R^iv^  ■ 


(5.55) 


The  same  situation  as  before  applies  and  is  used  to  evaluate  the  coefficients.  Considering  the 
Taylor  series  expansion  of  X2,  using  Equations  (5.55)  and  (3.1),  the  term  KiJ PEuE  will  contribute 
terms  with  even  powers  of  R.  Referring  to  Equation  (5.26),  the  Taylor  series  expansion  of  22  when 
(7i  =  0  is 


Z2{R)  = 


_C^ 

i?2u;2 


(1  -  yi?"  -  + 


Ki 

R?uj^  ■ 
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From  this,  it  can  be  seen  that  a  requirement  for  satisfying  Equation  (5.25)  is  that  Ki  —  C2- 
Therefore, 

zJR)  = - ^[sinh(a;i?)  -  ojR  cosh(ojR)]  -  ^-[cosh(cc»i?)  -  uR  smh{uR)  -  1]  .  (5.56) 

From  the  first  row  of  Equation  (5.12)  and  Equation  (5.56)  we  get 

Zx{R)  =  — sinh(aji?)  +  C2  cosh{uiR)  —  (72]  +  K2  ,  (5.57) 

where  K2  is  an  integration  constant.  Applying  the  terminal  constraint.  Equation  (5.48),  we  get 

AT,  =  ^  +  7;  .  (5-58) 

U) 

Hence,  ^ 

zx{R)  =  — sinh(a;i?)  +  C2  cosh(a;i?)  —  C2]  4 — ^  +  7/  •  (5.59) 

Rjjj^  U) 

The  constants  Ci  and  C2  can  be  determined  from  the  initial  state  ~x{Ro).  From  Equations 
(5.55)  and  (5.59)  we  obtain 

ZiiRo)  =  70  -  ^0  =  — r[(7i  sinh(a;i?o)  +  C2  cosh(u;i7o)  -  <72]  +  -^  +  7/  » 

KqU)^  ^ 

and 

22(7^0)  =  -tan(^o)/7?o 

r*  c 

-  -■^-r[sinh(c<;Ro)  -  wi?o  cosh(cj72o)]  -  ■^y^[cosh(u;7?o)  -  ujRosmh{u;Ro)  -  1]  . 

RqOJ^ 

Hence,  (7i  and  C2  are  the  solution  of  the  linear  algebraic  equation: 

RqU!  —  sinh(u;iEo)  1  —  cosh(a’i?o) 

/  —  sinh(a;7?o)  '\  /  “■  cosh(a;i?o)  ^ 

^  +wi?o  cosh(a;i?o)  j  V  +a;i?o  sinh(a>7?o)  / 


—  RqU}^ 


7o  -  ^0  -  7/ 

—  tan(<5o) 


(5.60) 


At  this  point,  the  closed  form  solutions  to  the  (untransformed)  state  variables  for  the  con¬ 
strained  final  angle  of  approach  case  may  be  obtained.  We  have 

'y{R)  =  —  j}'-z[Ci  smh.{ix>R)  -|-  (72  cosh(u;i?)  —  C2]  +  J^2 

4.  tan-'(-^[sinh(a;R)  -  wR cosh(a;i?)]  -h  -^[cosh(a;R)  -  ujRsmh{u^R)  -  Ij)  ,  (5.61) 

RuP' 

and 

8{R)  =  tan~^(  [sinh(c<;.R)  —  u;i2 cosh(u;i?)]  -|-  ■p--"[cosh(a;R)  —  a;i? sinh(u;i?)  —  1])  .  (5.62) 

We  have  arrived  at  closed  form  solutions  for  the  state  variables  for  the  constrained  intercept 
angle  case.  These  are  given  by  Equations  (5.61)  and  (5.62).  Such  closed  form  solutions  were  not 
obtained  in  the  original  formulation.  See  Lin.t^^ 
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RELATIONSHIP  BETWEEN  STATE  AND  ADJOINT  VARIABLES  -  TERMINAL 
CONSTRAINT  ON  INTERCEPT  ANGLE  CASE 


We  first  formulate  the  Riccati  equation  for  this  case,  which  also  gives  a  relationship  between 
the  state  and  adjoint  variables.  Setting  Pj  =  0  and  P2  =  P  in  the  first  row  of  Equation  (5.15)  we 
get 

Y(P)  =  -firiHO,P)na2(0,P)y(P)  +  fin'(0,P)^(0)  .  (5-63) 

Set  M{P)  =  au^(0,P)  •  fli2(0,P).  Differentiating  Equation  (5.63)  gives 


d-7  dM_^ 


dP 


^(0). 


(5.64) 


Substituting  Equation  (5.63)  into  the  second  row  of  Equation  (5.13)  yields 

^  =  -Q[M^  +  p)^m  +  wy  . 

Substituting  Equation  (5.65)  into  Equation  (5.64)  gives 


(5.65) 


^  -  MQM-^  -  Mwy  -  •  (^-^e) 

dP  dP 

Substituting  Equation  (5.63)  into  the  first  row  of  Equation  (5.13)  gives 


d  z 


dP 


WM-^  +  WDr/(0,  P)  V(0)  -  S"p  . 


(5.67) 


Equating  Equations  (5.66)  and  (5.67),  since  these  equations  hold  tor  any  'p  and”?(0),  gives  the 
following  two  equations  : 

^  -  MQM  -  MW  -  WM  +5  =  0  (5.68) 

and 

^  -  lVnr,'(0,/>)  -  MQflr,'(0,i>)  =  0  .  (5.69) 

The  boundary  constraint  for  Equation  (5.68)  is 

M(0)  =  -nn'(0, 0)0i2(0, 0)  =  7  •  0  =  0  .  (5.70) 

The  initial  condition  for  Equation  (5.69)  is  fij'AO, 0)  =  7.  Equations  (5.63),  (5.68),  (5.69)  and 
(5.70)  give  the  relationship  between  the  state  variables  ~z  and  the  adjoint  variables  ^  in  this 
case. 
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CHAPTER  6 

NUMERICAL  EXAMPLES 


In  this  chapter,  several  numerical  examples  of  the  linearized  k  guidance  are  given.  These 
numerical  examples  are  an  attempt  to  evaluate  the  performance  of  the  linearized  kappa  guidance 
method.  A  comparison  to  the  original  method,  which  is  presented  in  Lint^J,  is  given.  First, 
individual  trajectories  generated  by  each  method  are  compared.  These  results  are  shown  in 
Figures  6-1  through  6-4.  Each  figure  shows  a  trajectory  generated  by  the  original  k  method  and  a 
trajectory  generated  by  the  linearized  k  method.  In  each  case,  the  origin  of  the  trajectory  (launch 
point  of  the  missile)  is  at  (0,0)  and  the  PIP  is  at  (1,0),  giving  i?o  =  1-  The  constant  a;  is  set  to 
one.  For  all  of  the  these  examples,  the  program  was  set  to  stop  when  R  <  0.01.  The  abscissa 
on  these  figures  is  downrange  and  the  ordinate  is  altitude  above  a  reference  launch  altitude  href 
(plots  depict  range  vs.  href-)  No  particular  units  are  represented;  however,  these  figures  may 
be  considered  to  be  in  miles.  In  Figure  6-1,  'fo  —  —  t: jZ  and  7/  =  FREE.  In  Figures  6-2, 

6-3  and  6-4,  70  =  ^0  ==  7r/3.  In  Figure  6-2,  7/  =  ~7r/2.  In  Figure  6-3,  7/  =  0.  In  Figure  6-4, 
=  7r/2.  The  trajectory  in  Figure  6-4  is  presented  for  the  purpose  of  demonstrating  a  terminal 
approach  opposite  that  of  Figure  6-2  and  to  provide  a  more  complete  comparison  of  the  linearized 
K  guidance  method  with  the  original  k  guidance  method. 

Figures  6-5  through  6-7  are  cost  curves.  Recall  that  smaller  cost  means  a  higher  intercept 
velocity.  Each  of  these  figures  shows  the  costs  for  a  particular  family  of  trajectories.  For  each 
trajectory  whose  cost  is  shown  in  Figures  6-5  through  6-7,  the  origin  of  the  trajectory  is  at  (0,0) 
and  the  PIP  is  at  (1,0).  Equation  (2.2)  is  used  to  compute  the  cost  of  every  trajectory  in  this 
report.  In  Figure  6-5,  the  costs  of  trajectories  with  free  final  angle  of  approach  with  various  initial 
heading  error  angles  are  computed.  Each  point  of  the  abscissa  represents  one  of  these  trajectories 
with  a  specific  initial  heading  error  angle.  The  corrseponding  ordinate  value  is  the  cost  associated 
with  that  angle.  Trajectories  with  initial  heading  error  angles  within  8q  G  [—1-5, 1.5]  are  computed. 
For  the  linearized  method,  it  was  not  possible  to  compute  trajectories  for  \6o\  >  1.2.  It  may  be  seen 
that  the  costs  of  trajectories  computed  with  the  linearized  method  are  close  to  those  computed 
with  the  original  method  for  [(Jo I  <  0-8 •  The  third  curve  shown  in  Figure  6-5  gives  costs  for  various 
60  using  Equation  (5.47).  It  is  seen  that  Equation  (5.47)  is  a  close  approximation  to  the  true  cost 
of  a  trajectory,  computed  by  either  method,  for  80  €  [—0.5, 0.5]. 

In  Figures  6-6  and  6-7,  the  initial  heading  error  angle  is  fixed  and  the  final  angle  of  approach 
(or  final  velocity  vector  angle)  is  varied.  In  Figure  6-6  we  have  60  =  0,  and  in  Figure  6-7  we  have 
80  =  7r/3.  That  is,  for  Figure  6-6,  costs  for  trajectories,  computed  with  both  methods  with  =  0, 
are  plotted  for  7/  €  [-1.5, 1.5].  The  costs  in  this  figure  computed  by  each  method,  for  a  7/  are 
nearly  identical.  The  costs  for  trajectories  computed  by  the  two  methods  in  Figure  6-7  are  still 
comparable,  although  they  are  not  as  close  as  in  Figure  6-6.  The  linearized  method  has  a  slightly 
lower  cost  for  7y  G  [ — 1.5,  — !•!],  while  the  original  method  has  the  lower  cost  for  7/  €  [  1-1, 1,5]. 
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FIGURE  6-3.  70  =  <!>o  =  7r/3,7/  =  0 
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FIGURE  6-4.  70  =  <^0  =  7r/3,7/  =  7r/2 
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FIGURE  6-5.  COST  CURVE  FOR  70  =  <5o  €  [-1-5, 1.5],  7/  =  FREE 
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FINAL  APPROACH  ANGLE  (RAD) 

FIGURE  6-6.  COST  CURVE  FOR  70  =  <50  =  0,7/  G  [-1.5, 1.5] 
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Figures  6-8  and  6-9  are  cost  trajectories.  These  figures  show  the  accumulating  cost  of  a 
trajectory  from  the  origin  to  the  PIP.  For  a  general  system  with  n  dimensional  state  space,  a 
trajectory  is  plotted  in  [n  -j-  2)  dimensional  space;  see  Athans-Falb,l'^l  Figure  5-17(b),  page  312. 
Projecting  onto  the  cost-time  (the  independent  parameter)  plane  gives  curves  such  as  in  Figures 
6-8  and  6-9.  In  Figure  6-8  we  have  =  ^/3,  and  the  final  angle  of  approach  is  free.  Cost 
trajectories  for  both  methods  are  plotted.  The  final  costs  for  these  cost  trajectories  are  given  in 
Figure  6-5.  In  Figure  6-9  we  have  So  =  ir/Z  and  the  fixed  final  angle  of  approach  is  7/  =  -7r/2. 
The  costs  of  these  trajectories  are  given  in  Figure  6-7. 

Figures  6-10,  6-11  and  6-12  are  cost  curves  as  Figures  6-5,  6-6  and  6-7.  The  same  cost  curves 
for  the  original  method  are  plotted  as  in  Figure  6-5,  6-6  and  6-7,  that  is,  in  Figure  6-10  we  have 
Sq  £  [-1.5, 1.5]  and  7/  is  free,  in  Figure  6-11  we  have  (5o  =  0  and  7/  €  [-1.5, 1.5]  and  in  Figure 
6-12  we  have  60  =  tt/Z  and  7/  €  [-1.5, 1.5].  Instead  of  comparing  with  the  linearized  method,  as 
was  done  in  Figures  6-5,  6-6  and  6-7,  a  parabola  was  fitted  over  the  curve  in  each  of  the  figures. 
The  parabolic  curve  fit  is  close  in  each  of  these  figures.  This  close  fit  indicates  that  the  cost  has 
the  potential  of  being  functionalized.  A  functionalized  cost  curve  may  be  useful  in  operational 
situations.  For  example.  Figure  6-11  shows  that  it  would  be  straightforward  to  compute  cost 
for  intercepting  at  different  angles.  Cost  could  be  computed  for  all  angles  by  computing  for  two 
angles  since  two  angles  would  determine  a  parabola  (with  one  angle  at  the  minimum). 

As  was  mentioned  previously,  both  the  original  method  and  the  linearized  method  give  sub- 
optimal  solutions  that  make  different  approximations.  Since  these  two  methods  generate  two 
different  suboptimal  solutions,  we  do  not  expect  that  their  corresponding  trajectories  match  up. 
This  is  why  the  trajectories  in  Figures  6-1  through  6-4  do  not  match.  Looking  at  the  trajectories 
in  Figure  6-1  for  example,  the  trajectory  by  the  linearized  method  is  longer  and  attains  a  higher 
altitude  than  the  trajectory  by  the  original  method.  It  seems  that  the  original  method  gives  a 
trajectory  with  a  higher  curvature  early  on  which  results  in  a  fast  reduction  in  the  heading  error 
angle.  The  trajectory  generated  by  the  linearized  method  has  a  smaller  curvature  early  in  the 
trajectory  which  results  in  a  gradual  reduction  in  the  heading  error  angle.  The  cost  function. 
Equation  (2.2),  involves  both  of  these  factors  (curvature  and  heading  error  angle)  and  evidently 
heading  error  angle  can  only  be  reduced  through  the  use  of  curvature.  One  may  suggest  that  the 
flight  times  (from  launch  to  arrival  at  the  PIP)  of  a  missile  actually  flying  the  two  trajectories  may 
not  be  the  same.  For  the  original  method,  the  higher  curvature  at  the  beginning  will  reduce  speed 
to  a  greater  extent;  however,  the  path  is  shorter.  For  the  linearized  method  the  lower  curvature 
will  allow  a  more  gradual  reduction  in  speed.  Any  time  difference,  if  it  does  exist,  is  not  relevant 
since  the  cost  criterion  for  the  purposes  of  this  report  is  given  by  Equation  (2.2),  which  (as  stated 
previously)  maximizes  terminal  velocity. 

The  trajectories  in  these  figures  were  computed  differently  for  each  method.  Considering  the 
linearized  k  guidance  method,  first  an  incremental  length  along  the  trajectory.  As,  is  set.  The 
current  values  of  the  state  variables,  the  downrange  and  altitude  coordinates,  and  the  range  R 
to  the  PIP  are  assumed  given.  These  variables  are  substituted  into  Equations  (5.32)  and  (5.33) 
for  the  free  terminal  constraint  case  and  into  Equations  (5.61)  and  (5.62)  for  the  fixed  final  angle 
of  approach  case.  These  formulas  give  the  new  velocity  vector  angle,  7,  the  missile  should  have. 
Using  7  and  As,  the  trajectory  is  incremented.  What  has  been  described  is  an  Euler  method, 
while  what  is  actually  used  is  a  two-point  method.  The  velocity  vector  angle  used  is  the  average  of 
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FIGURE  6-8.  COST  TRAJECTORY  FOR  70  =  60  =  7r/3,7/  =  FREE 
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FIGURE  6-10.  COST  CURVE  FOR  70  =  <5o  €  [-1.5, 1.5],  7/  =  FREE 
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FINAL  APPROACH  ANGLE  (RAD) 


FIGURE  6-11.  COST  CURVE  FOR  70  =  <5o  =  0,7/  G  [-1-5, 1.5] 
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FIGURE  6-12.  COST  CURVE  FOR  jo  =  8o^  7r/3,7/  G  [-1.5, 1.5] 
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that  computed  at  the  beginning  and  end  of  a  trajectory  increment.  For  the  original  method,  again 
the  current  values  of  the  state  variables,  the  downrange  and  altitude  coordinates,  and  the  range 
R  to  the  PIP  are  assumed  given.  Then  the  optimal  input,  /c,  to  the  plant  equations  (Equation 
(2.1))  is  computed  using  the  optimal  feedback  controller  equations  previously  mentioned  in  Lin^ 
and  the  plant  is  integrated.  The  downrange  and  altitude  coordinates  are  incremented  using  the 
same  procedure  used  with  the  linearized  method.  The  original  k  guidance  method  is  coded  in 
FORTRAN  while  the  linearized  k  guidance  method  is  coded  in  MATLAB. 

For  either  method,  if  the  PIP  were  to  change  at  some  point  during  the  generation  of  the 
trajectory,  the  new  PIP  would  be  used  in  the  computation  of  the  next  trajectory  increment,  (if 
it  were  assumed  that  a  missile  had  flown  the  trajectory  up  to  that  point)  and  the  trajectory 
computation  would  proceed  as  described  above.  Now,  suppose  a  missile  is  flying  a  midcourse 
trajectory  with  free  final  angle  of  approach.  Let  the  PIP  move,  sometime  during  the  course  of  the 
flight,  in  such  a  way  that  the  final  angle  of  approach  is  undesirable  from  an  operational  standpoint 
(e.g.,  seeker  looking  into  the  sun).  With  the  linearized  method  described  in  this  report,  such  a 
circumstance  could  be  checked  using  the  closed  form  solution  for  the  velocity  vector  angle  given 
by  (5.32)  and,  if  necessary,  the  rest  of  the  midcourse  trajectory  could  be  recomputed  using  a 
specified  fixed  final  angle  of  approach  (e.g.,  not  into  the  sun).  With  the  original  method,  such  a 
circumstance  could  be  checked  only  by  recomputing  the  whole  trajectory. 
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CHAPTER  7 
CONCLUSION 


This  report  presents  an  alternate  solution  method  to  the  k  guidance  optimal  control  problem. 
The  primary  feature  of  this  alternate  method  is  that  closed  form  solutions  to  the  state  variables 
have  been  computed  for  both  the  free  terminal  angle  of  approach  case  and  the  fixed  terminal  angle 
of  approach  case.  Such  solutions  do  not  exist  for  the  original  method.  The  closed  form  solutions 
to  the  state  variables  for  the  linearized  method  established  in  this  report  may  be  advantageous 
in  certain  operational  or  simulation  situations.  For  example,  simulation  studies  may  require  less 
computing  through  the  use  of  the  closed  form  solutions.  In  operational  situations  requirements 
may  be  presented,  for  example,  that  certain  velocity  vector  angles  be  avoided.  The  closed  form 
solutions  presented  in  this  paper  may  be  able  to  quickly  determine  if  such  requirements  are  met. 
It  was  seen  in  Chapter  6,  the  Numerical  Examples  chapter,  that  the  cost  curves  can  probably 
be  functionalized.  Finally,  we  remark  that  the  technique  of  linearization  with  quadratic  cost 
approximation  may  be  of  use  as  a  general  technique  for  computing  suboptimal  solutions  to  optimal 
control  problems. 
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APPENDIX  A 

STATE  EQUATION  AND  COST  FUNCTION  DISCREPANCY 
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In  this  appendix,  we  will  discuss  the  discrepancy  of  the  state  equations  and  cost  function  in 
this  report  with  the  state  and  cost  function  for  kappa  guidance  given  in  Lin,t^"^^  Gray-Hecht,t^~^^ 
OhlmeyerE^-^l  and  Serakos-LinJ'^-^l  To  make  this  appendix  self-contained,  we  repeat  the  state 
equations  and  cost  function  as  presented  in  this  report.  The  state  equations  are 

A  f  1  _  f  «isec(6i)  _ 

dP  Si  Kisec{Si) +  ta.n{Si) /{R^  -  P)  \ 


The  cost  function  is 

J(7i,^i,P,Ki)  =  [(/c?/2)  sec(<Si)dP  .  (A.2) 

j  0 

The  state  equations  and  cost  function  for  kappa  guidance  as  given  by  the  above  mentioned  ref¬ 
erences  are  in  terms  of  the  range  R  (recall  R  =  R^  —  P).  The  state  equations  as  given  by  the 

references  are  r  n  r  /  \ 

72  ^  -K.2sec{S2)  _ 

dP  S2  -/C2  sec  (62) -tan  (^2)/^  J 

The  cost  function  as  given  by  the  references  is 

^(72, 62,  R,  «2)  =  [(«2/2)  +  sec  (^2)  dR  .  (A.4) 


The  “1”  and  “2”  subscripts  are  intended  to  distinguish  variables  used  in  the  two  formulations 
thereby  avoiding  confusion.  Substituting  R  =  Ro  —  P,  dRjdP  —  —1  into  Equation  (A.l)  results 


in 


d  7i 
dR  [  Si 


dP  Si 


—Ki  sec  (61) 

— Ki  sec  (^i)  —  tan  (^1)  / R 


(A.5) 


which  is  identical  to  Equation  (A. 3).  The  same  substitution  in  Equation  (A.2)  gives 


f  [(/Ci/2) -t- sec(^i)dP=  I  [(/Ci/2) -f  sec(<5i)  (— l)di2 
Jp=0  JR=fto 

which  does  not  match  with  Equation  (A.4).  Treating  P  as  a  dummy  variable  in  Equation  (A.2) 
and  jR  as  a  dummy  variable  in  Equation  (A.4),  these  two  equations  are  identical. 

The  distinction  between  the  first  pair  of  equations  and  the  second  pair  of  equations  is  that 
“dP”  is  positive  in  both  Equations  (A.l)  and  (A.2)  while  “dP”  is  negative  in  Equation  (A.3)  and 
positive  in  Equation  (A.4).  To  apply  the  minimum  principle  as  it  is  given  in  Athans-Falb,!"'^"®^  the 
differential  of  the  independent  variable  must  have  the  same  sign  in  both  the  state  equations  and 
the  cost  function.  Looking  at  the  proof  of  the  minimum  principle  in  Athans-Falb,l^~®^  page  309, 
Equation  (5-503),  an  augmented  differential  equation  is  formed  out  of  the  integrand  of  the  cost 
function  and  the  state  equations.  This  augmentation  requires  that  the  differential  of  the  state 
equations  and  the  cost  function  be  the  same,  i.e,  have  the  same  sign.  In  other  words,  applying 
the  minimum  principle  as  stated  in  Athans-Falb,^^~^^  to  the  optimal  control  problem  given  by 
Equations  (A.3)  and  (A.4),  and  introducing  a  minus  sign  to  Equation  (A.4)  so  that  the  “dP's” 
line  up,  the  cost  function  is  negative.  To  illustrate  this  point  further,  consider  the  following 
example: 
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Example  :  Consider  the  system 


£ 

dt 


Cl 

■  0 

1  ■ 

Cl 

+ 

■  0  ■ 

C2 

0 

0 

C2  _ 

1 

u 


(A.6) 

(A.7) 


with  cost  function 

J  rp2  J'2 

I  {(2  + Y)Cl  +  2rC2«  +  yu^}dt. 

The  initial  time  is  t  =  T  and  the  final  time  is  t  =  0.  The  initial  condition  is  (Ci(T),  C2(T)) 
=  (Cir,C2T)  and  the  final  condition  is  free.  The  differential  “df’  is  negative  in  Equation 
(A.6)  and  positive  in  Equation  (A.7).  Ignoring  the  difference  in  the  sign  of  the  differential 
and  applying  the  minimum  principle,  we  get  that  the  Hamiltonian  is 


H  =  (2  +  y )(!  +  ■  (2+ 


The  adjoint  equation  is 

d~p 


dt 


dH 

dX 


Pi  +  (4  +  T^)C2  +  2Tu 


(A.8) 


(A.9) 


The  terminal  conditions  for  the  adjoint  variables  are  (pi(0),p2(0))  =  (0,0).  The  optimal 
control  is  .  . 

*  _  _  ( ^  ,  p£\ 

“  I  J.  +  J2  I  • 


(A.IO) 


The  Hamiltonian  system  is 


d 

7 

■  w 

-s  ■ 

7 

dt 

.  £ . 

-Q 

-w 

.  £ . 

where 

0  1 

[  0  -2/r  J 

The  Riccati  equation  is 

dK{t) 


,Q  = 


0  0 
0  r2 


,  and  S 


0  0 
0  1/T^ 


dt 


+  KW  +  W'K  -  KSK  +  Q  =  0. 


The  boundary  condition  is  A^(0)  =  0.  The  solution  to  the  Riccati  equation  is 


K  = 


0 

0 


0 


sinh(t) 


sinh(t)  —  t  cosh(t)  J 
Note  that  K  is  negative  definite.  The  Hamilton- Jacobi  equation  is 

.X  n 


(A.11) 


(A.12) 


(A.13) 


(A.14) 


(A.16) 


The  reason  we  use  the  state  and  cost  given  by  Equations  (A.l)  and  (A. 2)  is  because  we  want 
to  use  the  minimum  principle  as  it  is  given  in  Athans-Falb.l^“®l 
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APPENDIX  B 

TERMINAL  COST  ON  INTERCEPT  ANGLE 


B-l/B-2 


NSWCDD/TR-94/367 


In  this  appendix,  an  intercept  angle  is  specified  by  assigning  a  cost  on  any  deviation  from 
that  intercept  angle.  The  terminal  cost  constraint  may  be  thought  of  as  a  “soft”  constraint  on 
the  intercept  angle.  This  is  in  contradistinction  to  the  case  where  an  intercept  angle  was  fixed, 
which  is  a  “hard”  constraint. 

The  Hamiltonian  system  is 


d 

~z 

W 

-s  ■ 

z 

dp 

.  y  . 

.-Q 

-W 

.  ~v  . 

where 


W  = 


0  1 
0  2/R 


0  0 
0 


and  S  = 


0 

0 


The  solution  to  the  linear  homogeneous  equation.  Equation  (B.l),  is 


0 

l/i?2 


(B.l) 


(B.2) 


Hli  fll2 
H21  H22 


(A,P2) 


(^2), 


(B.3) 


where  the  Qij  are  (unknown)  2x2  matrices.  We  set  the  terminal  cost  to  be 


K{lt)  =  ^c^{xi-jfY  =  \Rz2)  +  ^jy  .  (B.4) 


This  is  a  quadratic  cost,  which  is  in  keeping  with  our  LQR  setup.  The  transversality  conditions 
for  this  terminal  cost  are 


Pi(P  =  Ro) 

_ 

P2{P  =  Rn) 

d~t 

=  c^{zi{P  =  Ro)  +7/) 


1 

0 


(B.5) 


The  known  initial  conditions  on  't{P  =  0)  (state  variables)  and  Equation  (B.5)  give  all  the 
necessary  boundary  conditions  for  Equation  (B.l).  Two  boundary  conditions  are  on  the  state 
variables  and  two  conditions  are  on  the  adjoint  variables.  Rewriting  Equation  (B.5), 


y  (P  =  Rn)  =  <h 


■  1  0  ■ 

■  2i(P  =  Ro)  ■ 

+  <^7 

■  1  ■ 

Oy 

0  0 

Z2{P  =  Ro)  . 

0 

7/ 


Setting  Pi  =  0  and  P2  =  R  and  substituting  this  into  Equation  (B.3)  gives 


1  f^22(-f^5  -P)  “■  ^ 


1  0 
0  0 


nr2{Ro,P)\y{P) 


~  i  ^ 


1  0 
0  0 


Thus, 


On(i?o,  P)  -  ^^2l(i^o,  -P)|  ^(P)  +  c.y 

f{P)  =  K{P)-^{P)  +  T(P)  •  7/  , 


•7/ 


(B.6) 


(B.7) 
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where  we  have  set 


/ir(P)  =  |o22(-Ro,/’)-C^  I  0  J^12(Po,P) 

•jc,  J  Q  On(Po,P)-f22i(i?o,P)|  , 


7(P)  =  |fi22(Po,P)-C,^Q  pJni3(Po,P)|  •^•[oj- 
Here,  g{P)  is  a  2  x  1  column  vector.  We  have  that  K  satisfies  the  Riccati  equation, 


^  +  KW  +  W'K  -  KSK  +  Q  =  0  , 
dP 


and  satisfies 


=  (KS  -  W')t  . 


From  Equations  (B.6)  and  (B.7),  we  have 


K(R^)  =  c^  *  j  ,  and  7(-So)  =  c,  J 


(B.8) 

(B.9) 

(B.IO) 

(B.ll) 

(B.12) 


These  boundary  conditions  are  independent  of  7/;  hence,  they  may  be  solved  once,  numerically, 
and  stored. 
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